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1.0  INTRODUCTION 


Constrained  minimization/maximization  problems  are  of  interest  in  many  engineering 
disciplines  as  well  as  mathematics  and  physics.  This  problem,  often  described  as  opti¬ 
mization,  consists  of  a  performance  (objective)  function  to  be  minimized  and  a  number 
of  inequality  and  equality  functions  which  define  the  region  of  interest  (constraint  bound¬ 
ary  of  the  region).  Both  the  objective  and  constraints  are  functions  of  a  common  set  of 
variables.  Some  of  the  constraints  are  derived  from  the  system  performance  bounds,  and 
others  are  simply  the  limits  on  the  variables  themselves.  This  optimization  problem  is  of 
such  generic  interest  that  it  has  attracted  significant  attention  in  the  research  community 
over  the  last  forty  years.  As  a  result,  a  number  of  highly  sophisticated  linear  and  nonlinear 
programming  algorithms  are  available  at  present  for  a  variety  of  applications.  Notwith¬ 
standing  these  developments,  there  are  serious  shortcomings  in  the  way  of  applications  to 
large  scale  multidisciplinary  design.  The  optimality  criteria  method!1  has  the  potential 
to  extend  optimization  to  problems  with  thousands  of  variables  and  constraints.  One  of  the 
significant  elements  of  the  optimality  criteria  method  is  the  concept  of  scaling.  Scaling  im¬ 
plies  changing  the  variables  with  the  objective  of  bringing  the  constraints  to  the  boundary. 
The  constraints  can  be  brought  to  their  boundaries  either  by  adding  differential  quantities 
or  by  multiplying  the  variables  by  scale  factors.  The  latter  is  called  scaling.  This  procedure 
was  originally  proposed  for  constraints  which  could  be  scaled  in  a  single  step! 1  :iK  Later 
it  was  generalized  for  nonlinear  functions!-1,4).  In  both  cases,  however,  a  simple  scaling 
algorithm  was  used,  and  it  was  adequate  for  structural  optimization  problems.  On  simple 
scaling  a  dominant  constraint  can  be  identified,  and  scaling  with  this  constraint  generally 
brings  the  remaining  constraints  into  the  feasible  region.  This  is  not  necessarily  the  case 
in  general  mathematical  optimization  problems,  and  a  compound  scaling  is  necessary  in 
order  to  extend  the  scope  of  the  optimality  criteria  method.  Another  significant  element 
of  the  optimality  criteria  method  is  modification  of  the  variable  vector  at  the  constraint 


houndary  by  directly  invoking  the  optimality  as  defined  by  the  Kuhri-Tuckerronditions^. 

The  object  of  this  paper  is  to  give  a  comprehensive  derivation  of  the  compound  scaling 
algorithm  with  examples  to  illustrate  its  effectiveness  in  reaching  the  constraint  surface 
or  the  intersection  of  the  constraints.  The  details  of  its  application  in  optimization  are 
given  later^.  It  is  worthwhile  pointing  out,  however,  that  it  is  tacitly  assumed  that  the 
optimum  in  constrained  minimization  (or  maximization)  problems  lies  on  the  constraint 
boundary  or  at  the  intersection  of  the  constraint  boundaries.  All  other  cases  belong  to 
unconstrained  minimization  problems,  and  they  are  not  relevant  to  the  present  paper. 

It  is  often  necessary  in  optimization  problems  to  scale  the  constraint  functions  to  their 
boundary,  since  most  optimal  solutions  in  constrained  minimization  (or  maximization) 
problems  are  at  the  boundary  of  the  feasible  and  nonfeasible  regions.  This  can  be  accom¬ 
plished  by  a  numerical  search  in  the  context,  of  nonlinear  programming.  However,  this 
numerical  search  can  be  tedious  and  time  consuming.  A  simple  scaling  algorithm,  without 
formal  mathematical  derivation,  was  first  used  in  1968^  to  locate  the  constraint  bound¬ 
ary  in  a  single  step.  This  simple  scaling  algorithm  was  generalized  in  1988^3,4^  to  include 
constraints  that  require  more  than  one  scaling  step.  A  formal  mathematical  derivation, 
starting  with  a  first  order  Taylor  Series  approximation,  was  presented^3,4).  The  algorithm 
was  still  a  simple  scaling,  because  it  was  assumed  that  scaling  with  a  single  dominant  con¬ 
straint  function  would  satisfy  the  remaining  constraints.  This  is  the  case  in  most  structural 
optimization  problems  when  all  the  variables  belong  t.o  an  active  set.  References  (3)  and 
(4)  define  active  and  passive  variables  as  well  as  act  ive  and  passive  constraints. 
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2.0  MATHEMATICAL  STATEMENT  OF  THE  PROBLEM 


The  constrained  optimization  problem  can  be  stated  mathematically  as  follows: 

Minimize  or  maximize  a  function  F(t) 

F(t)  =  F(T,,x2....Jn)  (1) 

subject  to  the  inequality  constraints 

2_,(xi,x2  . . .  x„)  <  z}  j  -  1.2  ...  k  (2) 

and  equality  constraints 

zJ(xi,r2...xn)  =  z}  j  +  (3) 

The  basic  procedure  for  the  solution  of  this  numerical  optimization  problem  is  to  de¬ 
vise  a  search  strategy  to  find  the  optimum,  starting  from  a  given  initial  solution.  Most 
successful  search  techniques  are  generally  based  on  the  constraint  and  objective  function 
gradient  information.  This  gradient  information  is  most  meaningful  (effective)  when  it 
is  determined  at  the  constraint  boundary  (separation  between  the  feasible  and  the  infea¬ 
sible  regions  -  Fig.l),  because  the  optimum  is  usually  on  this  boundary  in  constrained 
minimization  (maximization)  problems.  As  a  result,  constraint  boundary  location  is  ex¬ 
tremely  important.  An  efficient  optimization  algorithm  should  have  the  facility  to  reach 
this  boundary  at  a  minimum  computational  cost  from  any  point  in  the  n-dimensional 
space.  The  purpose  of  the  compound  scaling  algorithm  is  to  provide  such  facility. 
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CONSTRAINT  1 


The  details  of  how  to  use  this  scaling  algorithm  for  the  solution  of  the  optimization 
problem  are  given  in  Reference  5.  The  discussion  in  this  paper  is  limited  to  the  following 
problem.  Given  an  initial  solution  x,  how  to  scale  x  such  that  none  of  the  constraints  are 
violated  while  at  least  one  of  the  constraints  is  at  the  boundary. 


3.0  DEVELOPMENT  OF  SIMPLE  SCALINO 

The  underlying  assumption  of  simple  scaling  is  that  there  exists  a  dominant  (most 
violated)  constraint  and  scaling  with  respect  to  this  constraint  will  bring  all  the  other 
constraints  to  the  feasible  region.  This  is  not  true,  in  general,  when  the  constraints  are 
nonlinear  or  when  the  variables  do  not  all  belong  to  an  active  set.  In  such  cases  a  compound 
scaling  algorithm  is  necessary  and  it  will  be  discussed  in  the  next  section.  However,  the 
simple  scaling  is  still  the  basis  for  the  development  of  the  compound  scaling  algorithm, 
and  its  details  are  presented  here  for  proper  understanding.  The  simple  scaling  procedure 
was  discussed  earlier^'^  but  will  be  repeated  here  for  completeness.  Classification  of 
constraints  based  on  their  relationship  to  the  constraint  boundary  precedes  the  application 
of  the  scaling  algorithm.  The  next  subsection  discusses  the  procedure  for  classification. 

3.1  ('lassification  of  Const  mints 

The  initial  variable  vector,  s.  is  assumed  to  be  given.  Evaluation  of  all  the  constraints 
with  this  variable  vector  results  in  three  cases: 

•  CASE  1:  Some  constraints  are  violated. 

•  CASE  2:  None  of  the  constraints  are  violated. 

•  CASE  3:  Some  constraints  are  at  the  boundary  ami  others  arc1  not  violated. 

The  first  two  cases  are  the  candidates  for  scaling,  and  it  is  usually  not  necessary  to  scale 
in  the  third  case. 

Tin1  three  cases  can  be  discerned  in  an  easy  way  by  examining  a  set  of  .i  parameters 
or  target  response  ratios.  The  :i  parameter  is  defined  as 


-) 


(-1) 


where  the  subscript  j  indicates  the  jth  constraint  (Eqs.  2,  3).  z}  is  the  limiting  value  of 
the  constraint.  z}  is  the  computed  value  of  the  constraint  with  the  given  or  the  assumed 
variable  vector,  x.  Based  on  the  0  values  the  constraints  can  be  classified  into  three 
categories: 

•  Violated  constraints  -  Infeasible  region 

•  Active  constraints  -  On  the  constraint  boundary 

•  Inactive  or  passive  constraints  -  Feasible  region 

The  3  values  for  these  three  cases  are  defined  for  various  situations. 


3.1.1  Positive  Constraints  i j  >  0 

For  positive  constraints  four  cases  can  arise: 

1.  0  <  0j  <  1  Violation  for  all  Positive  Constraints 

2.  0}  =  1  Active  Constraint 

3.  0j  >  1  Inactive  or  Passive  Constraint 

4.  0j  <  0  Inactive  or  Passive  Constraint 


F  i  g  :  2  CONSTRAINT  CLASSIFICATION 
POSITIVE  CONSTRAINTS 
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3.1.2  Negative  Constraints  zj  <  0 
Here  again  four  cases  can  arise: 

1.  fi}  >  1  Violation  for  ail  Negative  Constraints  -  Infeasible 

2.  0j  <  0  Violation  for  all  Negative  Constraints  -  Infeasible 

3.  0  <  <  1  Inactive  or  Passive  Constraint  -  Feasible 

4.  Pj  =  1  Active  Constraint 
These  four  cases  are  illustrated  in  Fig.  3. 


oo 


t 


+ «® 


P  «  —  | - ►  P 


INFEASIBLE  •  FEASIBLE  •  INFEASIBLE 

«  - - — - «!« - ► 


F  i  q  :  3  CONSTRAINT  CLASSIFICATION 
NEGATIVE  CONSTRAINTS 

The  following  rules  are  recommended  in  order  to  facilitate  the  formulation  and  imple¬ 
mentation  of  the  algorithm.  The  first  two  rules  pertain  to  the  formulation,  and  the  last 
two  rule1-  to  the  implementation. 

Rule  1:  The  first  step  in  classifying  constraints  is  to  formulate  all  the  inequality  con¬ 
straints  as 


z)  ^  2; 


(o) 
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If  there  are  constraints  in  the  form  z}  >  z},  multiply  both  sides  of  the  inequality  by  —I. 
Then  these  inequalities  reduce  to  —z,  <  — 

Rule  2:  If  z}  is  zero,  then  take  one  of  the  terms  from  the  left  side  of  the  inequality  to 
the  right.  If  there  is  only  one  term  on  the  lefthand  side,  then  let  z.  =  r  where 

M*o. 

Rule  3:  If  Zj  becomes  zero,  then  write  the  inequality  as 

_«/rf  o  /  r/ 

-}  '22 
^>A<1  ^nld 

Now  the  new  z"ru'  ~  z,dd  -  ‘J2  and  the  new  z’}iew  =  ‘2  .  The  new  and  z}  are  used  in 
the  definition. 

Rule  4:  If  (3  is  zero  or  negative,  assume  a  small  value  (positive)  for  (3  (.1  or  less)  and 
scale  first.  Then  evaluate  the  constraint  and  continue  scaling  until  (3  becomes 
positive. 


3.1.3  Classification  Based  on  a  Margin  of  Safety  (MS)  Definition 

It  is  sometimes  more  convenient  to  classify  the  constraints  based  on  the  definition  of 
margin  of  safety  (MS).  The  original  inequality  constraint  is  given  as 


This  inequality  can  be  redefined  in  terms  of  MS  as 

MS.  -  -  lj  >  0 

Now  if  Zj/Zj  is  defined  as  )i,  then 

M.S.  =  {ft,  -  1)  >  0 


(7) 


(8) 
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(9) 


Now  three  possible  cases  arise: 


CASE  1:  ft  >  1  Positive  MS  -  Feasible  Region 

CASE  2:  ft  ~  1  At  the  Constraint  Boundary 

CASE  3:  ft  <  1  Negative  MS  -  Infeasible  Region 

If  all  the  constraints  have  a  positive  MS,  then  it  is  advantageous  to  bring  the  nearest 
constraints  to  their  boundary  by  scaling.  If  some  of  the  constraints  have  a  negative  MS. 
then  it.  is  necessary  to  bring  them  to  the  constraint  boundary  by  scaling.  When  some  of 
the  constraints  are  at  their  boundary  and  others  are  all  with  a  positive  MS,  then  no  scaling 
is  necessary. 

3.2  Scale  Factor  Derivation  For  Simple  Sealing 

The  first  objective  of  scaling  is  to  bring  all  the  violated  constraints  to  the  feasible  region 
or  to  the  constraint  boundary.  If  all  the  constraints  are  in  the  feasible  region,  then  scaling 
can  be  used  to  bring  some  of  the  constraints  to  the  constraint  boundary.  The  mathematical 
basis  for  scaling  can  be  derived  from  the  first  order  approximation  of  a  Taylor's  series. 

The  vector,  x.  is  the  given  or  assumed  vector  of  variables,  jt  is  the  scaled  vector  to 
bring  the  violated  constraints  to  the  feasible  region.  The  relationship  between  these  two 
vectors  in  simple  scaling  is  assumed  to  be 

x  =  \x  (10) 

where  A  is  a  scalar  multiplier  for  all  the  variables.  Let  the  differential  vector  dx  be  defined 
as 

dx  -  x  -  x  -  (A  -  l)x  (11) 
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If  Zj  is  the  constraint  function,  the  first  order  approximation  of  a  change  in  z}  due  to  a 
change  in  x  can  he  written  as 


()Zj  ()z}  ()z} 


Substitution  of  ( J  J )  into  (12)  gives  an  expression  for  dz}  as 


(12) 


«fe,  =  (A-l)X>V«  (13) 

i  i 

where  n  in  the  summation  represents  the  number  of  variables  participating  in  the  change. 
It  is  assumed  in  this  derivation  that  all  the  variables  are  participating.  The  constraint 
gradient  NtJ  (different  iation  of  the  jlh  constraint  with  respect  to  the  i,h  variable)  is  defined 
as 


Oz, 

v  —  1 

1  Ox, 


(14) 


Now  Eq.  13  can  be  written  as 

il-  n  V  r 

j  =  (a  -  d^t  w 

-j  ,  ,  ~j 

An  examination  of  Eq.  15  presents  two  interesting  cases  which  will  be  discussed  in  detail 
in  the  next  two  subsections. 


3.2.1  Case  1 


The  first  case,  henceforth,  will  be  referred  to  as  the  active  case  for  distinction.  This 
designation  comes  from  the  discussion  of  active  and  passive  variables  in  References  3  and 
4.  This  case  corresponds  to 

"  X  r 

Y.  ’  <  0  (16) 

.  I  -i 

In  this  rase  a  parameter  fi}A  is  defined  as 


"  y,}x, 

»JA=  -  Z.  * 

,  I  ^ 


(17) 
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With  this  definition  Eq.  15  can  he  written  as 


Now  the  scale  factor  K}  4  can  be  written  as 


where  bj  is  defined  as 


Eq.  19  can  also  he  written  as 


dz ,  1 


1  dz, 


~~ 

1<jA  zj 


A, 4  1  -  6,  ~  1  +  h> 


by  neglecting  the  higher  order  terms  of  b  in  a  binomial  expansion,  provided 


\bj\ «  1 


From  Eq.  21  -TJ  can  be  written  as 


~j  _  jA 

~  A  JA  ~  ",A 


“1  njA 

The  constraint  value  z}  corres]>onds  to  the  variable  vector,  s.  and  z}  +  dz}  corresponds  to 
the  new  variable  vector  r.  If  the  object  is  to  bring  the  constraint  to  the  boundary,  then  it 


can  be  written 


:j  —  zj  +  dzj 


From  the  definition  of  the  /I  parameter  (in  Eq.  4).  Eq.  24  can  he  written  as 


VjA  ,  , 

A  jA  ,}A  +  1 


Solving  for  tho  scale  factor,  \jA.  from  Eq.  2G  gives 


k  _ 

}A  (ij  +  HJA  -  1 

Now  r  can  be  written  as 

=  at  (28) 

The  approximations  indicated  in  Eqs.  21  and  25  are  contingent  upon  two  conditions. 
The  first  condition  is  the  first  order  approximation  of  a  Taylor's  series  which  limits  the 
application  to  small  changes.  The  second  condition  is  contingent  upon  the  parameter  |b| 
being  very  small  compared  to  1.  From  Eqs.  2G  and  21,  b  can  be  written  as 

6=  1  (^-i)  (29) 

b*]A 

OBSERVATION  1:  It  is  interesting  to  note  that  for  the  case  of  \ijA  =  1,  the  scale  factor, 
A }A.  given  by 

A =  i  (30) 

is  exact  regardless  of  the  range  of  The  first  order  approximat  ion  in  the  Taylor's  series 
expansion  and  tho  inverse  first  order  approximation  in  the  binomial  expansion,  Eq.  21, 
appear  to  eliminate  the  approximation  altogether  at  least  for  the  case  of  —  1. 

OBSERVATION  2:  If  all  u  terms  in  the1  summation  in  Eq.  17  are  of  the  same  sign  and 
the  degree  of  nonlinearity  is  >  1,  then 


f',A  >  1  (31) 

OBSERVATION  3:  The  parameter  //  is  a  measure  of  nonlinearity  of  the  constraint  func¬ 
tions.  This  fact  was  used  to  construct  an  interaction  formula^  which  will  be  generalized 
later  in  this  section. 
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3.2.2  Case  2 


The  second  case,  designated  as  the  passive  case,  is  when 


"  N„x, 

L  > » 

i 


i  i 


A  n  parameter  is  then  defined  as 


Vjl’  = 


N„z, 


t  l 


Then  the  scale  factor  K}j>  can  he  written  as 


hi’ 


f  l1)!’  ~  1 

ll)l' 


(32) 


(33) 


(34) 


OBSERVATION  4:  The  scale  factor  as  derived  from  Eq.  34  is  only  valid  for  small  changes, 
consistent  with  the  first  order  Taylor  series  approximation,  except  when  //_,/>  =  1. 

OBSERVATION  5:  The  scale  factor  in  Case  1  is  inversely  proportional,  while  the  scale 
factor  in  Case  2  is  directly  proportional  to  the  target  response  ratio,  fj. 

The  second  subscripts  A  and  P  ill  the  definitions  of  the  parameters  //  and  A  are  simply 
for  the  convenience  of  distinguishing  Cases  1  and  2.  This  distinction  is  very  crucial  for 
identifying  active  and  passive  variables  in  scaling.  The  main  point  is  not  which  case 
represents  the  active  or  passive  condition,  hut  instead  it  is  to  recognize  that  these  two 
are  distinctly  different  cases,  and  Case  1  should  he  handled  as  an  inversely  proportional 
condition  while  Case  2  is  a  directly  proportional  condition. 

3.3  Interaction  Formula  for  the  Scale  Factor 

The  scale  factors  derived  from  the  first  order  approximation  of  a  Taylor’s  series,  Eqs. 
27  and  34,  represent  an  interesting  generalization  for  nonlinear  functions.  However,  the 
nature  of  approximation  is  such  that  its  usefulness  is  limited  to  a  very  narrow  range  of 
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about  10  to  1 5l7  on  either  side  of  the  series  expansion  ((i  value  of  0.85  to  1.15).  Beyond 
this  range  the  error  of  approximation  is  not  acceptable,  because  it  may  take  too  many 
scaling  steps  to  reach  the  constraint  boundary.  To  overcome  this  difficulty  an  interesting 
interaction  formula  was  proposed*4*  in  1988.  The  purpose  of  this  interaction  formula  is  to 
extend  the  range  of  application  of  the  scaling  algorithm  from  —  oc  to  oo,  while  retaining 
most  of  the  accuracy  accustomed  to  in  linear  scaling.  After  a  brief  discussion  of  the 
motivation  behind  this  interaction  formula,  a  forma)  generalization  will  be  presented  with 
the  help  of  simple  mathematical  functions. 

A  formula  involving  linear  and  nonlinear  interaction  is  written*4*  for  the  special  case  of 
a  beam  where  axial  deformation  represents  a  linear  condition  and  bending  deformation  a 
nonlinear  condition.  An  interaction  formula  is  based  on  the  assumption  that  exact  scaling 
formulas  are  available  at  the  two  extreme  conditions:  i.e.  when  the  beam  deformation  is 
entirely  due  to  axial  forces,  the  scaling  formula  is  given  by 

A  cx  *  (35a) 


The  other  extreme  is  when  the  beam  deformation  is  entirely  due  to  bending.  Then  the 


scaling  formula  is  given  by 

A  K  (a)" 


(356) 


where  the  parameter  n  is  a  measure  of  nonlinearity  represented  by  the  bending.  However, 
when  the  actual  deformation  is  a  result  of  both  the  axial  and  bending  forces,  then  an 


approximate  interaction  formula  can  be  written  as 


A  =  "A‘ 

t‘Aj  \  P/ 


(35c) 


For  the  notation  of  the  parameters  in  Eq.  35c  see  Reference  4. 


The  basis  for  generalization  of  the  scaling  algorithm  can  be  established  by  examining 
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the  fi  and  (1  parameters  of  two  simple  constraint  functions 


r,  c  i 

Z\-  +  + 

T,  r2 


<  z, 


(36) 


22  =  c ,X,  +  C2r 2  +  •  •  •  +  rnXn  <  22 


(37) 


where  X\,x2  •  •  •  xn  arc  the  variables  and  Cj,C2  •  •  •  cn  are  a  set  of  positive  constants.  The 
quantities  2\  and  z2  ar<>  the  limits  of  the  inequalities.  The  p  parameters  in  these  two  cases 
are  defined  as 


Mm 


y  A'h-t, 
.  . 


1 


(38) 


Mi/'  =  2_  ,  -  1 

,  ,  -2 


(39) 


Interestingly,  the  measure  of  nonlinearity  in  both  these  cases  is  1,  and  it  represents  the 
linear  case.  Now  the  parameters  (i  are  defined  as 


ft  = 


2l 

-I 


(40) 


fh  =  :2  (4i) 

-2 

It  is  easy  to  show  that  the  exact  scab*  factors  in  these  two  cases  are  simply 

Am  =  ^  (42) 


\2r  ~  Ih 


(43) 


The  first  condition  represents  Case  1  and  the  second  represents  Case  2  in  the  earlier 
discussion  in  Sections  3.2.1  and  3.2.2,  respectively.  A  similar  examination  of  two  nonlinear 
functions 


2| 


(44) 
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z2  -  C\x\n  +  c2x2‘  +  •  •  •  +  cnx™  (45) 

gives  an  interesting  result.  The  c's  are  again  assumed  to  be  positive  constants.  The  p 
parameters  for  these  two  cases  are 

=  m  (46) 


p2p  =  in 


(47) 


The  measure  of  nonlinearity  in  these  two  rases  is  m.  It  is  easy  to  again  show  that  the 
exact  scale  factors  for  these  two  cases  are 


A 


1  A 


(48) 


A2/>  =  (49) 

Now  an  examination  of  constraint  functions  with  both  linear  and  nonlinear  terms 


c,  c2 

:\  =  +  + 

J-,  x2 


*"n  I  1 


+ 


+  £  <  i 

•*  n 


(50) 


~i  =<•,-»■  I  +  Cl*2  + - f  <'n^"n  +  Cri  +  •••  4  C2flT™  <  1  (51) 

gives  the  basis  for  the  interaction  formula  derived  intuitively  earlier*'1*  (Eq.  35c).  The 
parameter  p  in  these  cases  is  no  longer  a  constant,  but  instead  it  straddles  between  limits 
1  and  m,  i.e., 

1  <  ft  <  m  (52) 

This  means  that  the  measure  of  nonlinearity  varies  between  the  two  extremes  depending 
on  the  values  of  the  variables.  For  example,  when  the  values  of  the  x's  are  very  large 

i  --  1,2, ...  v 

I « 


x,  »  1 


(53) 


the  value  of  the  /x  parameter  for  the  the  first  constraint  approaches  the  lower  limit  1. 
Conversely,  it  approaches  the  upper  limit  m  when  the  x'»  are  very  small. 

/,  <  1  i  —  1,2. ...  n  (54) 

The  second  constraint,  Eq.  51,  represents  the  opposite  case  in  the  sense  that  the  //  pa¬ 
rameter  would  be  1  for  small  values  of  x,  and  tn  for  large  values.  It  is  assumed  that  the 
elements  of  the  normalized  c  vector  are  not  too  far  from  one. 

The  suggested  interaction  formulae  in  these  two  cases  are 

Am=<,'G,)+°2U)  (55) 


A 2/»  -  fll  (fa)  +  «2  (^2) 


I 

tn 


(50) 


where  the  first  term  represents  the  linear  contribution  while  the  second  is  the  nonlinear 
part.  However,  it.  turns  out  that  these  interaction  formulae  are  equivalent  to 


Am  - 


(57) 


A  2/*  =  (fa)*'*1’  (58) 

The  scale  factors  given  by  Eqs.  57  and  58  are  far  superior  approximations  than  those 
given  by  Eqs.  27  and  34.  The  range  of  their  application  is  not  limited  to  10  to  15‘7  on 
either  side  of  fi  -  1.  However,  they  are  not  exact  when  the  summation  in  the  /x  parameter 
definition  contains  both  positive  and  negative  terms.  In  such  cases  two  scale  factors  are 
defined  for  each  constraint.  These  correspond  to  Case  1  and  Case  2  discussed  earlier.  For 
example,  the  two  scale  factors  for  the  j,h  constraint  can  be  defined  as 
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3.3.1  Case  1 


(59) 


3.3.2  Case  2 


1 


(60) 


The  definition  of  V)A  and  fiji>  in  Eq.  59  and  60  is  as  follows: 


and 


"  V  j 

\  '  -Yi jx» 

VjA  =  -  L  . 

,  I 


(17a) 


fl 

*J)f’  =  X! 


A'.jJ-t 


(33a) 


The  important  distinct  ion  between  the  original  equations  (17  and  33)  and  their  alternates 
(17a  and  33a)  is  that  the  two  summations  include  only  terms  of  the  same  sign.  In  other 
words  the  sum  in  Eq.  17a  includes  only  negative  terms  and  similarly  Eq.  33a  contains 
only  positive  terms. 


The  scale  factor  \}/y  is  applicable  to  all  the  variables  that  contribute  to  the  sum  in  Eq. 
17a.  Similarly,  the  scale  factor  A ;/>  is  applicable  to  the  variables  in  the  sum  in  Eq.  33a. 


3.3.3  Limitations 

The  following  limitations  apply  to  the  scale  factor  calculated  from  Eqs.  59  and  60. 

1.  If  A,  4  »  1  or  1.  then  no  scaling  should  be  allowed,  because  such  a  condition 
represents  a  pathological  or  asymptotic  condition,  and  the  scaling  would  be 
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counter-productive.  In  such  cases  the  default  is  \}A  =  1  which  represents  no 
scaling. 

2.  The  same  rule  applies  to  A}/>  as  well. 

3.  A  reasonable  quantitative  limit  for  A}  is  as  follows  (in  order  to  avoid  large 
changes  in  the  variables): 

0.01  <  A, 4 (or  A;/»)  <  100  (Gl) 

These  limits  are  good  for  the  first  scaling  where  the  initial  variable  vector  is  selected 
arbitrarily.  In  subsequent  scalings  this  range  can  be  reduced  even  further 

0.1  <  \}A(ot  A,/.)  <  10  (G2) 

As  stated  earlier  scaling  is  not  allowed  outside  this  range  which  means  \jA  or  A =  1 .0 

This  generalization  of  assigning  more  than  one  scale  factor  leads  to  the  concept  of  com¬ 
pound  scaling  where  each  variable  can  have  a  separate  srale  factor. 

3.3.4  Options 

When  the  two  scale  factors  \jA  and  A }p  are  computed  for  each  constraint,  two  cases 
can  arise: 

1.  One  of  the  scale  factors  is  out  of  bounds  (as  defined  by  Eqs.  Gl  and  62).  in 
which  case  the  other  scale  factor  is  the  only  one  valid  for  scaling.  Although  the 
possibility  of  both  scale  factors  being  out  of  bounds  is  very  remote,  it  indicates 
that  scaling  is  not  possible  from  that  point. 

2.  Both  scale  factors  are  within  the  bounds  in  which  case  they  are  both  valid  for 
scaling.  In  this  case  two  options  must  be  examined. 
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OPTION  J:  Both  scale  factors  arc  used  for  st  a  ling.  The  active  scale  factor  A^  4  is  used  for 
scaling  the  variables  that  contributed  to  the  negative  sum  in  the  p  parameter  definition, 
while  A j[>  is  used  for  the  other  variables.  In  such  a  case,  movement  towards  the  feasible  or 
infeasible  region  is  fast  and  may  result  in  overshooting  the  constraint  boundary.  Additional 
scalings  using  the  two  scale  factors  may  result  in  oscillation  about  the  constraint  boundary 
and  in  too  many  scaling  steps. 

OPTION  2:  Only  one  scale  factor  is  used;  i.c.  only  the  active  or  passive  variables  (cor¬ 
responding  to  or  A ji>)  are  allowed  to  participate  in  the  scaling.  The  overshooting 
problem  is  mitigated  in  this  case.  Now  the  question  is  which  one  is  a  better  choice?  This 
decision  is  based  on  determining  whether  this  constraint  is  basically  governed  by  Case  1 
or  2  (inversely  or  directly  proportional  to  ft).  This  determination  is  quite  simple  when 
A ja  and  A }i>  are  determined  with  equal  values  for  all  the  variables.  The  largest  of  the  two 
A's  (A or  A ji>)  is  the  governing  condition.  This  condition  (active  or  passive)  remains 
the  same  regardless  of  what  happens  in  subsequent  solutions.  For  example,  if  both  A 's 
are  within  the  bounds  in  the  solution  with  equal  values  for  all  the  variables,  and  A^  is 
the  largest  of  the  two,  then  A^  is  the  governing  condition  in  this  and  all  the  subsequent 
solutions.  Scaling  for  this  constraint  remains  an  active  case  even  if  is  greater  in  subse¬ 
quent  solutions.  This  conclusion  is  based  on  the  assumption  that  when  all  the  variables  are 
equal  (with  no  bias),  the  p  parameters  describe  the  function  behavior  more  realistically. 
If  the  solution  is  not  with  equal  values  for  all  the  variables,  then  the  decision  has  to  be 
deferred  until  one  of  the  two  scale  factors  goes  out  of  bounds.  Once  \]A  or  A _,/•>  goes  out  of 
bounds,  it  is  an  indication  that  it  will  not  be  the  governing  condition  for  this  constraint. 
If  both  scale  factors  remain  within  the  governing  condition  is  by  computing  A}/\  and  i}/> 
with  equal  values  for  all  the  variables. 

Another  important  case  that  needs  attention  is  when  ft  is  very  small  (says  ft  <  0.01) 
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and  one  of  the  scale  factors  is  out  of  hounds.  In  this  case  the  same  scale  factor  should  he 
applied  to  all  the  variables.  This  condition  differs  from  the  case  when  ,i  is  not  too  small 
(/i  >  0.01)  and  one  of  the  scale  factors  is  out  of  hounds.  In  such  a  case  scaling  is  applied 
only  to  the  variables  belonging  to  the  scale  factor  in  hounds,  and  the  variables  belonging 
to  the  out  of  bounds  scale  factor  are  left  at  their  current  values  (no  scaling). 

So  far  the  discussion  has  been  in  the  context  of  a  single  constraint.  An  extension  of 
these  ideas  to  the  environment  of  multiple  constraints  loads  to  a  formal  derivation  of  a 
compound  scaling  algorithm  in  the  next  section. 


4.0  COMPOUND  SCAL1NC  ALGORITHM 

The  compound  scaling  algorithm  is  a  further  generalization  of  the  scaling  algorithm 
presented  in  the  previous  section.  It  is  assumed  that  there  is  no  single  dominant  constraint, 
and  the  scaling  has  to  be  applied  for  multiple  constraints  in  order  to  bring  them  to  the 
feasible  region  or  to  the  constraint,  surface.  To  put  it  succinctly,  “scaling  is  a  process  by 
which  the  variables  are  adjusted  such  that  the  constraints  are  brought  to  the  constraint 
surface  or  into  the  feasible  region". 

The  compound  scaling  algorithm  requires  throe  important  tables  or  rectangular  arrays. 
All  three  tables  (arrays)  are  of  the  same  dimension  »  (rows)  x  s  (columns),  where  n 
represents  the  number  of  variables  and  s  represents  the  number  of  active  constraints. 

The  first  table  is  the  constraint  gradient  matrix.  .Yn  , , ,  which  is  either  given  or  a  facility 
exists  for  its  generation.  It  is  also  assumed  that  all  the  constraints  can  be  evaluated  for 
a  given  variable  vector  x.  To  reiterate,  the  following  information  is  necessary  in  order  t.o 
develop  the  compound  scaling  algorithm. 

1.  Constraint  values  -  matrix  zs .  |  for  a  given  x 

2.  Constraint  gradient  matrix  N„,s  for  a  given  x 

3.  Scale  factor  table  (matrix) 

4.  Scale  fartor  assignment  table  (matrix) 

The  last  two  tables  are  generated  from  the  information  given  in  the  first  two  tables.  The 
first  two  tables  are  generated  from  an  analysis  of  the  system. 

4.J  Constraint  Values  Matrix  -  , 

For  a  given  variable  vector,  x,  all  the  constraints  can  be  evaluated  by  an  analysis  of  the 
system.  All  the  constraints  that  are  candidates  for  scaling  are  identified.  This  list  includes 
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all  the  violate**!  constraints  ami  those  close  to  the  constraint  surface  (within  5  to  10  '  <  ). 
The  number  of  constraints  useel  for  scaling  is  a. 


4.2  Constraint  Gradient  Matrix  -  Nu.„ 


The  elements  of  the  N  matrix,  Aru,  are  defined  as 


N, 


(03) 


This  information  is  also  assumed  to  he  available  from  an  analysis  of  the  system.  The 
format  of  the  constraint  gradient  matrix  is  shown  below. 

TABLE  1  Format  of  the  Constraint  Gradient  Table 


Constraints 

Variables 

1 

*2 


~2 


N 


n 


Nfi 


12 


N 


21 


22 


Ari, 


Aa 


fon  1  A b2  ... 

4.3  Generation  of  the  fi  Parameters 

From  the  constraint  gradient  matrix  a  set  of  p  parameters  is  generated.  The  //  pa¬ 
rameter  set  consists  of  2  x  s  entries.  That  is,  each  constraint  is  associated  with  two  // 


parameters,  and  they  are  defined  as  follows: 


"  Nijr, 

I'jA  =  -  L  - 

,  1  1 


where  the  above  sum  includes  only  negative  terms. 

n 

f'j/'  =  Y 


n  N  x 


(64) 


(65) 


,  i 

where  the  above  sum  includes  only  positive  terms.  The  subscript  j  represents  the  jth 
constraint.  The  second  subscripts,  A  and  P.  represent  the  active  and  passive  designation 
corresponding  to  Cases  1  and  2.  respectively,  in  simple  scaling  (reference  Eqs.  17  and  33). 


Now  for  each  constraint  compute  two  scale  factors  corresponding  to  the  two  //  param¬ 
eters. 


4.3.1  Case  1 


i 


(66) 


4.3.2  Case  2 


A  jr=  ( lijY”’  (67) 

The  interaction  formulas  discussed  in  1988^  ^  are  the  basis  for  Eqs.  64  and  65. 

4.3.3  Exceptions 

•  If  ;i  >  1  and  // ^ />  <?C  l  or  calculated  A }f>  »  I,  set  A j/>  ~  1.0 

•  If  [i  <  I  and  I  or  calculated  »  1,  set  A; ^  =  1.0 


24 


IJ"1 


•  For  all  other  cases  use  the  calculated  quantities. 

If  the  scale  factor  becomes  too  largo.  say  >  100,  it  indicates  a  pathological  condition 
and  by  setting  A;/»  or  \jA  -  1  the  scaling  is  by-passed  for  that  condition.  The  scaling  is 
by-passed  for  that  condition.  The  other  conditions  can  scale  the  variables. 

4.4  Scale  Factor  Table 

The  format  of  the  scale  factor  table  is  similar  to  the  constraint  gradient  table. 


TABLE  2  Format  of  the  Scale  Factor  Table 


Constraints  — » 

Variables 

J 

*1  A lA  or  A, 


A 2A  or  A 2/' 


s 


A.m  or  As/> 


*2 


Am  or  Aj p 


\iA  or  A 2/> 


Am  or  As/> 


xn 


A M  or  A)P 


\lA  or  \2p 


Am  A sp 


Each  of  the  entries  in  the  jih  column  is  either  \]A  or  A depending  on  the  variable's 
contribution  either  to  the  sum  p )A  or  p;/».  This  table  gives  s  possible  scale  factors  for  each 
variable.  Which  one  of  the  s  scale  factors  is  relevant  to  the  given  variable  is  determined 
with  the  help  of  a  scale  factor  assignment  table  and  the  constraint  gradient  table. 


25 


4.5  Scale  Factor  Assignment  Table 


The  format  of  the  scale  factor  assignment,  table  is  similar  to  the  constraint  gradient 
and  scale  factor  tables. 

TABLE  3  Format  of  the  Scale  Factor  Assignment  Table 

Constraints  —  z2  ...  zs 

Variables 


J-i 


J-i 


1 1 


t; 


21 


12 


'22 


'2.» 


>nl 


'  n2 


The  entries  ttJ  in  this  table  are  calculated  one  column  at  a  time  where 


t,j  - 


(68) 


The  parameter  fit]  belongs  to  fijA  or  /<7/»  depending  on  whether  the  argument  in  the 
absolute  value  is  negative  or  positive.  The  table  is  completed  when  all  the  .s  columns  are 
filled.  The  values  of  the  entries  in  the  scale  factor  assignment  table  vary  from  zero  to  one. 


4.6  Appropriate*  Seale  Factor  for  Each  Variable 


Now  all  the  information  is  available  for  the  selection  of  an  appropriate  scale-  factor  for 
each  variable  from  the  list  of  .s  scale  factors. 

Example:  Appropriate  scale  fa<  tor  for  the  ilh  variable. 

Rule  1:  From  the  scale  factor  assignment  table  select  the  largest  entry  in  the  ith  row. 

For  Example:  If  t,}  is  the  largest  entry  in  the  scale  factor  assignment  table,  then  the 
appropriate  scale  factor  for  the  ith  variable  is  the  \t}  scale  factor  from  the  scale  factor 
table. 

Rule  2:  If  there  is  more  than  one  entry  equal  to  the  largest  entry,  for  example:  t,}  is 
the  largest  entry  in  the  scale  factor  assignment  table,  but  /,*  and  t,f  are  also 
equal  to  t,y  Then  the  appropriate  scale  factor  is  any  of  the  three  (AtJ  or  A,* 
or  A,,). 

Now  complete  this  process  of  selecting  appropriate  scale  factors  for  all  the  variables.  Then 
the  scaled  variables  for  x,  are  computed  by 

T?cu'  =  xntld \,j  i  —  1 . 2  ...  ii  (09) 

where  AfJ  is  the  appropriate  scale  factor  for  the  ilh  variable  as  determined  by  the  two  rules. 

The  next  step  is  to  evaluate  all  the  constraints  with  the  new  variable  vector.  If  there  are 
any  violated  constraints,  the  scaling  algorithm  is  repeated. 

The  results  of  the  compound  scaling  algorithm  are  presented  in  the  section  on  results 
when  applied  to  specific  examples.  These  examples  do  not  address  the  complete  optimiza¬ 
tion  problem.  Only  the  scaling  aspect  is  addressed.  The  complete  implementation  of  the 
optimization  algorithm  is  given  in  Reference  5. 


27 


5.0  RESULTS  OF  APPLICATIONS 


Five  problems  were  selected  to  demonstrate  the  effectiveness  of  the  simple  and  com¬ 
pound  scaling  algorithms.  The  first  three  problems  are  well  suited  for  demonstration  of  the 
simple  scaling  algorithm.  The  last  two  problems  demonstrate  application  of  the  compound 
scaling  algorithm. 


PROBLEM  1.  The  inequality  constraint  function  is  defined  as 


.  .  10  15  25  40  ^ 

~i(3')  —  +  +  +  <1-0 

X  |  S‘i 


The  gradients  of  the  constraint  function  are  given  by 


At.  =  - 


10 


*21  =  - 


15 

r2 


*31  =  - 


25 

*3 


*41  =  - 


40 


CASE  1:  The  initial  solution  is  assumed  to  be 


x\  =  x.-i  -  x-x  =  x4  =  1.0 

For  this  solution  c((.r)  -  90  which  is  a  significant  violation  of  the  constraint.  For  scaling, 
the  ft  parameter  is  calculated  from  Eq.  64  as 

4  V  r 

tt  =  -  V  A“  ’  =  i.o 
,,  r' 

which  implies  that  the  measure  of  nonlinearity  is  1,  as  noted  earlier.  The  ft  parameter  is 
computed  by  Eq.  4  as 

n=  ^  =  0.0111111 


The  scale  factor  is  given  by  Eq.  66 


A  =  (90) 1/1  =  90 


28 


The  new  variables  are  given  by 


St  -  X2  =  T3  =  xA  -  90 


For  this  solution 


=  io 

The  constraint  boundary  has  been  reached  in  a  single  step,  and  the  scaling  is  considered 
to  be  exact. 

CASE  2:  The  initial  solution  is  assumed  to  be 


j-|  =  1  j*2  =  2  x3  —  3  ta  =  4 

For  this  solution  Zi(x)  —  35.8333  which  is  a  violation  of  the  constraint. 

A  A r„r, 

c  =  -L  ",  =1" 

«  i  1 

and 


fi  35.83  3  3  0(32  7  9 


Thus,  the  scale  factor  is  given  by 


A  - 


35.8333 


The  new  variables  are 


x,  =  35.8333  j i  ~  71.6067  x,  =  107.5  x<  =  143.333 


For  this  solution 


c,(x)  =  1.0 


Once  again  the  constraint,  surface  has  been  reached  in  a  single  step. 
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PROBLEM  2.  The  purpose  of  this  problem  is  to  show  that  the  scaling  can  he  exact,  under 
certain  conditions,  even  when  the  measure  of  nonlinearity  is  greater  than  1. 


The  inequality  constraint  function  is  defined  as 

,  .  30  2  108  47  ^  „ 

ri(J)  ~  i  +  i  -  10 

r\  X2  .1  -I 


The  gradients  of  the  constraint  function  are  given  by 

a-  _  90 

A "  ~  ~  ,4 

1 1  ■*  2 

The  initial  solution  is  assumed  to  be 


S-  G  V  324  »; 

•^21  —  “  4  ^Vll  —  _  4  J^4I 


T-, 


h 


141 

-4 


-  Ji  -  i  \  -  ^4  —  1.0 


For  this  solut  ion  c,  (x)  187  which  is  a  violation  of  the  constraint  . 


V,  j  jr. 


i  i 


3.0 


i.e..  the  measure  of  nonlinearity  is  3.0. 


= 


1 

187 


0.0053476 


The  scale  factor  is  given  by  Eq.  66 


A  =  ( 187) 1  :t  =  5.718479 


The  new  variables  are 


jq  =  j-2  =  X-,  —  X4  -  5.718479 


For  this  solution  C|(.r)  =  1.0 

Once  again  the  constraint  surface  is  reached  in  one  step. 


PROBLEM  3.  The  third  problem  is  designed  to  show  that  the  scaling  is  not  exact  when 
there  is  a  possibility  of  a  variation  in  the  degree  of  nonlinearity.  In  such  cases  scaling 


ran  take  more  than  one  stop.  Still,  it  would  b"  significantly  faster  than  any  search.  The 


constraint  function  is  defined  as 


10  30  15  2  25  108  40  47 

r  +  <  l.U 


Z I  (x)  —  +  ..  +  +  ..  +  +  •(  , 

y  1  x}  S'l  xj  S:i  X.|  -r.1  xj 

Gradients  of  the  constraint  function  are  given  by 


10 

90 

V„  - 

ri 

'1 

15 

6 

A’ 2,  = 

““  2 

4 

rl 

A;t  i  = 

25 

324 

s:\ 

X1, 

A'„ 

40 

141 

1 

H 

s5 

1 

'J 

The  initial  solution  is  assumed  to  be 

X,  .-  x-i  -  X; I  =  x4  =  1.0 

For  this  solution  Z\(x)  —  277  which  is  a  violation  of  the  constraint. 
The  parameter  n  is  given  by 


^  ■>  A ,  |  x, 


2.35018 


i  i 


-i 


The  parameter  fi  is  given  by 


The  scale  factor  from  Eq.  6G  is 


,1  --  =  0.00301 

277 


A  -  (277) "  '  10.94645 


The  new  variables  are  given  by 


x,  -  x2  =  x  ,  =  Tj,  -  10.94045 
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For  this  solution  tin*  constraint  function  C|(j*)  -  8.36441.  Tin*  constraint  is  still  violated. 
Second  Scaling 

The  constraint  gradients  with  the  new  variables  are  given  by 


The  parameter  p  is  given  by 


The  parameter  ii  is  given  by 


The  scale  factor  is  given  hv 


The  new  variables  are 


A',,  -  -0.0897 

Xn  =  -0.1 256 
A’:u  =  -0.2312 
.V4I  =  -0.3436 


.V,  |  x, 

p  =  -  >  =  1.03409 

Ci 

i  i 


'-  8.3644!  -  011955 


A  =  (8.36441)"  =  7.79879 


1 1  ~  s ^  T  j  Tq  —  85.3690 


and  the  new  constraint  value  for  this  solution  is 


c,(j-)  -  1.05455 

One  more  scaling  should  bring  the  constraint  to  the  boundary.  In  the  next  step  p  will  be 
reduced  to  1.0.  This  means  that  in  the  first  step  the  cubic  terms  dominated  and  gave  the 
p  value  as  2.35018,  and  in  the  second  step  the  p  value  was  reduced  to  1.03409. 
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PROBLEM  4.  This  problem  is  designed  to  demonstrate  the  compound  scaling  algorithm 
with  a  single  constraint.  The  constraint  is  defined  as 

2,(x)  =  180X)  +20x2-3.1x:$  +  0.2x4  -Sx^-t  37x|Xt4  S.Tx^x.,  -  3tjX4  -  ().lx*x2-f  OTXMxijx.i 

+95x|  x4  -  81x4x3  +  x‘  -  6.2x2  +  0.48x;j  +  22xij  <  1.0 

The  constraint  gradients  are  given  by 

Nu  —  180  -  8x2  +  37x;j  -  0.2xiX2  +  95x^  +  3x2 
N2]  =  20  -  5x,  +  8.7x4  -  0.1  Xj  +  ,002x2x3  -  18.6x2 
N3i  =  -3.1  +  37x,  -  3x,  +  O.OOIX2  -  162x4x  {  +  1.44x2 
jV4|  =  0.2  4-  8.7x2  -  3x:,  +  190X]X4  -  81x?j  +  66x4 

The  initial  solution  is  assumed  to  be 


3-1  =  X2  =  X;,  =  x4  =  1.0 


For  this  solution  2](x)  -  265.981  which  is  a  violation  of  the  constraint.  The  constraint 
gradients  are 


TV,  1  =  309.8 
N2i  =  5.002 
At3,  =  -129.659 
N4]  =  -180.90 

The  parameters  //  are  computed  separately  for  negative,  Eq.  64,  and  positive.  E<j.  65. 
sums. 


Via 

Vw  = 


N-.\  1  X  3 


0.487475 


A’,.', 

z\ 


1.863674 


The  parameter  f)  is  given  by 


fi  =  1  =  0.003759 
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=r  9425G.43 


i 


A,,.  -  (.*)"■!•  -  0.0499905 


The  parameter  A 14  »  1  represents  a  pathological  condition,  and  it  is  ignored.  So  the 
variable  x;!  will  not  be  scaled. 

The  new  variables  are 

■r,  .-=  0.0499905 
x-i  -  0.0499905 
jr. =  1.0 
j-.,  =-  0.0499905 


The  constraint  function  value  is  now  given  as 


r,(r)  =  5.06174 


Second  Scaliruj 


Arn  =  216.9945 
A*2i  =  20.1383 
A'.„  =  -  8.0588 
A’41  -  -82.7253 
//,  A  =  -  V  =  2.40910 

p,,.  =  Y.  =  2.34196 

i  1.2 

The  parameter  J  is  given  by 


,y  =  0.19750 


Am  =  (5.061 75)  "m  --  1.96042 
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A,/>  =  (0.19756) "w*  -  0.500344 


The  new  variables  are 


x ,  =  0.0250124 
x2  -  0.0250124 
*3  =  1.0 
x4  =  0.0499905 


The  constraint  function  for  these  new  variables  is  zx  (j)  =  —0.8649050. 

Third  Scaling 

JV,,  =  217.1140992 

7V2i  =  20.29820597 

Ar3,  =  -8.98296822 

N4l  =  -83.1798822 
N  x 

tiiA  =  -  V  "  '  =  6.8657883 
«  1,2 

H)P  =  Y.  =  1^.193772 

i  3,4  1 

Calculate  the  0  by  scaling  up  to  —0.1  in  order  to  avoid  a  negative  0  (see  Rule  4  sec  3.1.2) 


»  =  -oiewoo  =  01156190 


Am  =  (8.6490503) '"'a  =  1.3692072 


A|/>  =  (0.1156196)^«^  =  0.8676250 


The  new  variables  are: 

x,  =  0.02501241 
x  2  =  0.02501241 
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x;,  =  0.867G2503 


x.,  =  0.04337299 

Tho  constraint  function  value  is  now  j» ivt»n  as 


(x)  =  0.6929182 


Fourth  Seating 

N]  |  =  212.1575314 
A’2I  =  20.2406272 
A’.ii  =  -7.3169668 
A'4,  =  -62.8296117 
»\A  =  -  V  =  13.0946068 

v  ^  AT,  *  X- 

tur  =  y  =  8.3889252 

,  .,2  21 

The  parameter  (i  is  given  by: 

li  =  1.4431718 

A,  A  =  (0.6929182)"i4  =  0.9723739 

I 

A,/.  =  ( 1.4431718)  »‘ii'  =  1.0446997 

The  new  variables  are: 

x,  =  0.0261305 
x  2  =  0.0261305 
x;,  =  0.8676250 


x,  0.0433730 


The  constraint  function  value  is  now  given  as 


c,(x)  =  0.9527436 


Fifth  Scaling 

A7,,  =  212.1521012 
A72,  =  20.2339G9G 
N:ii  =  -7.2755990 
NAl  =  -G2.810G7 10 
HlA  =  -  Y.  IK,'S’  =  9.4850052 

I  3,4 

/ii;>  —  ^2  N'!X'  =  C. 3735460 

»  1,2 

The  parameter  ft  is  given  hy: 

ft  =  1.049G003 
A,^  =  0.9949092 
A|/<  =  1.0076243 

The  new  variables  are: 

x,  =  0.02G3297 
x2  -  0.02G3297 
x.i  -  0.8G7G250 
x„  =  0.0433730 

The  constraint  function  value  is  now 

zx  (x)  =  0.9990408 
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which  is  within  0.096%  of  the  constraint  surface. 


1/2 


1/2 


PROBLEM  5.  This  problem,  a  Rear  reducer  example,  is  designed  to  demonstrate  the  com¬ 
pound  scaling  algorithm  with  multiple  constraints.  A  detailed  description  of  the  problem 
is  given  in  Reference  6.  In  this  example  there  are  7  design  variables  and  25  constraints. 
The  constraints  are  defined  as: 

z\(r)  =  2l  <1.0 

z2{t)  =  3972r,5  < 

'  '  *1*2*3 

C3(x)  =  1  93s  2  <  1.0 

'  1  *2*3*J*6  “ 

c4(x)  =  19i  4  <  1.0 

2r,(x)  =  ft  <  1100.0 
2*1  -  ((*^)/+(16-9)10f>) 

Dx  =  0.1  xjj 
*(')  =  &  <  850.0 
M  =  ((  x?/,6)2  +  (1S7.5)10«) 

=  0.1  xi 

C7 (x)  =  X2X;i  <  40.0 

“8  (2")  =  /,*  <  -5-0 

c9(x)  =  <  12.0 

2,0(x)  =  x,  <  3.6 
~n(*)  =  -a’l  <  -2  6 
1 2  ( -2* )  =  *1  <  0-8 
-13(2’)  -  -  x2  <  -0.7 
=  x:t  <  28.0 
~ir,(x)  =  -x3  <  -  17.0 
^leU)  =  t-\  <  8.3 
c,7(x)  =  -x„  <  -7.3 
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i  h  (*r )  —  jr->  — 

'ty^)  -  ~s:>  <  “7.3 
~2o(-r)  =  Sf.  <  3.9 
z2i(x)  -  “J‘«  S  2.9 
c22(t)  =  J7  <  5.5 
“2.1  (-O  =  “3*7  <  “3.0 
SM(x)  =  (,  5^"  9)  <  1.0 

“2r.(-r)  =  ("IrV,9) 

The  initial  solution  was  selected  as  the  average  of  the  minimum  and  maximum  values 
defined  for  each  variable:  (constraints  z)0  thru  22:s)-  For  this  solution  constraints  5,  G.  8.  9 
and  10  were  violated.  Only  one  scaling  was  necessary  to  bring  all  the  violated  constraints 
to  the  feasible  region  or  to  the  constraint  boundary.  The  constraint  gradient  matrix  - 
Ny x 5 ,  the  scale  factor  table  and  the  scale  factor  assignment  table  are  given  for  this  scaling. 

TABLE  4  PROBLEM  5 :  Constraint  (Gradient  Matrix  for  Violated  Constraints 


z— * 

X 

1 

5 

6 

8 

9 

10 

1 

1 

0. 00(H) 

0.0000 

-1.3333 

0.0000 

0.0000 

2 

-9.7511 

-.8703 

5.5111 

0.0000 

0.0000 

3 

-.3250 

-.0290 

0.0000 

o.oooo 

o.oooo 

4 

.9376 

0.0000 

0.0000 

-.1151 

0.0000 

5 

O.(HHK) 

.0837 

0.0000 

O.OOOO 

-.1262 

6 

-926.1200 

0. 00(H) 

0.0000 

.1923 

0.0000 

7 

0.0000 

-495.7786 

0.0000 

O.OOOO 

.1410 

:<9 


TABLE  5  PROBLEM  5  :  Scale  Factor  Table 


z~* 

X 

5 

G 

8 

9 

10 

i 

1 

1.000000 

1.000000 

1.209677 

1.160126 

1.021703 

2 

.984560 

1 .006856 

.82G667 

1.160126 

1.021703 

3 

.984560 

1.006856 

.826667 

1.160126 

1.021703 

4 

1.000000 

1.000000 

.826667 

.897436 

1.021703 

5 

1.000000 

1.000000 

.820667 

1.160126 

.983974 

6 

.984560 

1.000000 

.826667 

1.160126 

1.021703 

i 

1 .000000 

1 .006856 

.826667 

1.160126 

1.021703 

TABLE  6 

PROBLEM  5  : 

Scale  Factor  Assignment  Table 

z— 

X 

5 

6 

8 

9 

10 

1 

1 

0.000000 

0.000000 

1 .000000 

0.000000 

0.000000 

2 

(X)6968 

.000752 

l.OO(KKK) 

0.000000 

0.000000 

3 

.006968 

.000752 

0.000000 

O.(HHKKK) 

0.000000 

4 

.006968 

0.000000 

O.(MKKKK) 

1.000000 

0.000000 

5 

0.000000 

.000752 

0.000000 

0.000000 

1.000000 

G 

3.000000 

O.OOO(KH) 

O.(KHKNK) 

.728571 

0.000000 

7 

0.000000 

3.000000 

0.000000 

O.IKMMKK) 

.752443 
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From  the  scale  factor  assignment  table,  the  scale  factor  table,  the  constraint  gradient 
table,  and  the  rules  enumerated  earlier,  the  appropriate  scale  factor  for  each  variable  was 
determined.  Table  7  gives  the  values  of  the  appropriate  scale  factors,  the  scaled  variables 
and  the  adjusted  variables  when  they  exceeded  tin*  limits. 


TABLE  7 

PROBLEM  5  : 

Values  of  the 

Variables  Before  and  After  Scaling 

Variable 

Original  x's 

Scab-  Factor 

Scaled  Variables 

Adjusted  Variables 

.310000E+01 

.  1209G8E  +  01 

.375000E-+01 

.3GOOOOE+01 

*2 

.  750000 E  +  00 

.82GG67E  t  00 

,G200(K)E  +  00 

.700000E+00 

*3 

.225000E  +  02 

.984560E  +00 

.22152CE  +02 

22152GE+02 

x4 

.780000E+01 

89743GE+01 

.700000E+01 

730000E+01 

*5 

.780000E+01 

.983974E+00 

.7G7500E+01 

.767500E+01 

*6 

.340000E+01 

.984560E+00 

.334750E+01 

.334750E+01 

r? 

.525000E+01 

.100G8GE+01 

.528600E+01 

.528G00E+01 

Table  8  gives  the  values  of  the  constraints  before  and  after  scaling. 
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TABLE  8  PROBLEM  5  :  Values  of  the  Constraints  Before  and  After  Scaling 


Constraint  No. 

Initial  Value 

Limit 

After  Scaling 

1 

.0882 

1.0 

.6909 

2 

.4503 

1.0 

.4592 

3 

.4061 

1.0 

.3856 

4 

.0714 

1.0 

.0721 

5 

1049.6000 

1 100.0 

1099.9000 

6 

867.6120 

850.0 

850.0560 

7 

16.8750 

40.0 

15.5068 

8 

-4.1333 

-5.0 

-5.1429 

9 

4.1333 

12.0 

5.1429 

10 

3.1000 

3.6 

3.6000 

11 

-3.1000 

-2.6 

-3.6000 

12 

0.75(H) 

0.8 

.7000 

13 

-0.7500 

-0.7 

-.7000 

14 

22.50(H) 

28.0 

22.1526 

15 

-22.5000 

-17.0 

-22.1526 

1G 

7.8000 

8.3 

7.3000 

17 

-7.8000 

-7.3 

-7.3000 

18 

7.80(H) 

8.3 

7.6750 

19 

-7.8000 

-7.3 

-7.6750 

20 

3.4000 

3.9 

3.3475 

21 

-3.4000 

2.9 

-3.3475 

22 

5.25(H) 

5.5 

5.2860 

23 

-5.2500 

-5.0 

-5.2860 

24 

0.8974 

1.0 

.9481 

25 

0.9840 

1.0 

1  (H)52 

These  five  examples  illustrate  the’  power  and  mechanics  of  the  scaling  algorithm.  Complete 
details  of  how  to  use  this  scaling  algorithm  are1  given  in  Reference  5. 


6.0  SUMMARY  AND  CONCLUSIONS 


This  paper  is  organized  into  six  sections,  inclusive.  The  first  two  sections  explain 
scaling  and  its  intended  purpose  in  the  context  of  constrained  mathematical  optimization. 
They  also  contain  a  brief  history  and  motivation  for  the  development  of  the  compound 
scaling  algorithm. 

The  third  section  generalizes  the  simple  scaling  discussed  earlier* 1  4*  with  additional 
observations  and  options.  The  subsection  on  classification  of  constraints  contains  a  com¬ 
prehensive  description  of  most  of  the  constraint  types  encountered  in  mathematical  opti¬ 
mization  and  provides  guidelines  for  effective  implementation  in  scaling.  The  interaction 
formula  for  the  scale  factor  was  originally  derived*1,1*  in  the  context  of  application  to 
beam  problems.  The  beam  deformation  can  be  separated  into  axial  and  bending  parts 
when  there  is  no  coupling  between  them.  The  axial  part  is  characterized  by  linear  behav¬ 
ior  while  the  bending  part  is  governed  by  nonlinear  behavior.  This  paper  derives  the  basis 
for  this  concept  in  the  context  of  general  mathematical  functions  while  extracting  a  much 
simpler  relationship.  This  relationship  in  turn  leads  to  the  compound  scaling  algorithm 
discussed  in  Section  4.  In  essence  the  compound  scaling  algorithm  is  an  elegant  extension 
of  simple  scaling  to  multiple  constraints. 

The  compound  scaling  algorithm  requires  basically  two  matrices.  The  first  is  the 
constraint  values  matrix,  z.  The  dimension  of  this  matrix  is  s  x  1,  where  a  represents 
the  number  of  active  constraints.  The  second  is  a  matrix  of  constraint  gradients  (table). 
N.  The  dimension  of  this  matrix  is  n  x  .s,  where  w  is  the  number  of  variables  and  a 
represents  the  number  of  active  constraints.  These  two  matrices  are  generally  obtained 
from  an  analysis  of  the  system.  From  this  information  two  additional  matrices  A  and  (  are 
generated.  The  dimensions  of  these  two  matrices  are  identical  to  those  of  the  A’  matrix. 
The  first  is  designated  as  the  matrix  of  possible  scale  factors  (table),  while  the  second 


is  called  the  scale  factor  assignment  matrix  (table).  The  information  from  the  last,  three 
tables  is  the  basis  for  an  orderly  derivation  of  individual  scale  factors  for  all  the  variables. 
Then  the  relationship  between  the  scaled  and  the  unsealed  variables  is  given  by 

r,  =  A ,t,  i  =  1.2  ...  v 

The  scaled  variables  are  closer  to  the  constraint  boundary. 

Section  five  contains  the  results  of  application  to  simple  mathematical  functions.  The 
first  two  examples  show  that  the  scaling  can  be  exact  no  matter  how  far  the  design  is 
from  the  constraint  boundary.  This  means  that  the  constraint  boundary  ran  be  reached 
in  a  single  step.  In  these  two  examples  the  parameter  //  remains  constant,  throughout  the 
n  —  dimensional  space,  and  the  scaling  is  exact.  The  third  example  shows  that  this  is  not  the 
case  when  the  parameter  //  varies  in  the  w —dimensional  space.  In  such  cases  scaling  would 
be  significantly  faster  than  any  search.  The  fourth  example  illustrates  application  of  the 
compound  scaling  algorithm  to  a  single  constraint.  The  last  example  is  an  application  to 
multiple  constraints.  These  examples  not  only  illustrate  the  advantages  and  the  limitations 
of  the  scaling  algorithm  but  also  the  details  of  application. 

The  characteristics  that  make  this  compound  scaling  algorithm  most  attractive  are 
outlined  as  follows: 

].  The  constraint  surface  can  be  reached  very  rapidly  from  anywhere  in  the  n— dimensional 
space. 

2.  All  the  decisions  in  scaling  are  tied  to  the  values  of  two  key  parameters  p  and  ft. 

3.  Determination  of  these  two  parameters  is  extremely  simple  and  computationally  in¬ 
significant  when  the  constraint  and  gradient  information  are  available  from  an  analysis 
of  the  system. 

•4.  Selection  of  appropriate  initial  values  for  the  variables  is  no  longer  an  issue. 
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5.  The  need  for  directional  searches  and  move  limits  is  eliminated. 

6.  The  step  si/e  determination  is  automatic  and  is  tied  to  the  values  of  the  parameters  fi 
and  (i. 

7.  Algorithm  implementation  is  simple  and  straightforward,  because  computational  over¬ 
head  beyond  an  analysis  of  the  system  is  almost  insignificant. 

Future  research  in  optimization  should  concentrate  on  the  behavior  of  the  mathematical 
functions  through  the  study  of  these  non-dimensional  parameters. 

This  compound  scaling  algorithm  constitutes  a  significant  breakthrough  in  the  evalu¬ 
ation  of  the  optimality  criteria  approach  for  large  scale  optimization  (with  thousands  of 
variables  and  constraints)  in  a  multidisciplinary  setting. 
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